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Period for Reply 



A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) OR THIRTY (30) DAYS, 
WHICHEVER IS LONGER, FROM THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1.136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 1 33). 
Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1.704(b). 

Status 

1 )S Responsive to communication(s) filed on 17 April 2006 . 
2a)E3 This action is FINAL. 2b)D This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 11, 453 O.G. 213. 

Disposition of Claims 

4) H3 Claim(s) 1-11 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) D Claim(s) is/are allowed. 

6) S Claim(s) 1-11 is/are rejected. 

7) D Claim(s) is/are objected to. 

8) D Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) D The specification is objected to by the Examiner. 

10)E3 The drawing(s) filed on 22 April 2004 is/are: a)S accepted or b)D objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1 .85(a). 

Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121(d). 
1 1 )□ The oath or declaration is objected to by the Examiner. Note the attached Office Action or form PTO-1 52. 

Priority under 35 U.S.C. § 119 

12)S Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 1 19(a)-(d) or (f). 
a)[EI All b)D Some * c)D None of: 

1. E3 Certified copies of the priority documents have been received. 

2. D Certified copies of the priority documents have been received in Application No. . 

3. Q Copies of the certified copies of the priority documents have been received in this National Stage 

application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 
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DETAILED ACTION 

Information Disclosure Statement 

1. The information disclosure statement (IDS) submitted on 04/22/04 has been considered 
by the Examiner. 

Claim Rejections - 35 USC § 103 
The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

2. Claims 1-10 are rejected under 35 U.S.C. 103(a) as being unpatentable over Mizuno 
(U.S. Patent 6,463,183 B2) in view of Tarn et al. (U.S. Patent 5,754,186). 

In reference to claims 1, 7 and 10, Mizuno discloses an image data processing method 
and apparatus and storage medium that extracts an object from an image and combines this 
object with another image to obtain a combined image without deteriorating picture quality (see 
column 2, lines 22-27). Mizuno discloses a computer system comprising a CPU, disk drive and 
a display, among other elements which extracts, for example, a tennis player's racket object from 
input moving image data which is stored in, possibly, the disk drive (see column 4, lines 37-39, 
column 5, lines 44-48 and column 6, lines 47-50). Note, the Office interprets that such 
extraction takes place at an equivalent to rate of, "every predetermined time" as the entire image 
data processing method of Mizuno is implemented by the CPU executing in a loop programming 
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structure (see Figure 8 of Mizuno) and therefore, the "every predetermined time" is interpreted 
as equivalent to the time taken for the CPU to perform all instructions in one iteration of the 
loop. Mizuno discloses the moving image data being in the format of an MPEG1 video format 
(see column 7, lines 55-58). Mizuno also discloses storing the object in memory (see column 2, 
lines 28-3 1). Mizuno discloses combining the racket object, which is extracted from moving 
image data, with a background image (see column 6, lines 12-16). Mizuno also discloses 
rendering the combined data continuously as the rendering step is located within the CPU loop 
structure of Figure 8 in Mizuno. Although, Mizuno discloses combining extracted object data 
from moving data and combining such object data with a background image, Mizuno does not 
explicitly disclose extracting input drawing static information from a drawn input image. Tarn et 
al. discloses a method and apparatus for blending of first and second images loaded into 
corresponding VRAM buffers (see column 3, lines 57-58 of Tarn et al.). Tarn et al. discloses the 
apparatus comprising a computer system which includes a writing device such as a pen or stylus 
that allows the user to write on the screen of a display (see column 5, lines 36-58 and column 6, 
lines 47-49). Tarn et al. discloses "extracting" such drawing information from memory and 
combining it with other image data such as video data (see column 3, lines 61-66, column 6, 
lines 49-61, column 7, lines 1-36 and columns 7-8, lines 67-4). Note, the image control section, 
image combining section and image drawing sections of Applicant's claims are interpreted 
functionally equivalent to the functions performed by the CPU of Mizuno. It would have been 
obvious to one of ordinary skill in the art at the time the invention was made to implement the 
pen/stylus and video based image combining techniques of Tarn et al. with the image data 
processing techniques of Mizuno in order to allow the viewing of real-time user interaction data 
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along with the computer system application data on a display simultaneously creating a more 
user friendly environment (see column 2, lines 34-49 of Tarn et al.). 

In reference to claims 2 and 8, Mizuno and Tarn et al. disclose all of the claim limitations 
as applied to claims 1 and 7 respectively above. The Office interprets that such extraction takes 
place at an equivalent to rate of, "every predetermined time" as the entire image data processing 
method of Mizuno is implemented by the CPU executing in a loop programming structure (see 
Figure 8 of Mizuno) and therefore, the "every predetermined time" is interpreted as equivalent to 
the time taken for the CPU to perform all instructions in one iteration of the loop. This amount 
of time is interpreted as greater than the time from which an object is extracted from moving 
image data. 

In reference to claims 3 and 9, Mizuno and Tarn et al. disclose all of the claim limitations 
as applied to claims 1 and 7 respectively above. The computer system of Mizuno comprises a 
keyboard which allows the user to capture a "screen shot" of a display by depressing the 
Ctrl+Shift+Print Screen buttons at the same time and therefore, the Office interprets that Mizuno 
inherently comprises a screen capture signal allowing the user to capture an image of screen 
since such a keyboard function is well known in the art (Official Notice). 

In reference to claim 4, Mizuno and Tarn et al. disclose all of the claim limitations as 
applied to claim 1 above. Mizuno discloses storing the moving image data in either a memory 
device, disk drive or hard drive (see column 6, lines 47-50). Mizuno also discloses a rendering 
section found within the CPU looping structure of Mizuno' s image data processing methods, 
which determines whether distribution is present within the image data and based on this 
determination, uses original color information or produces new color information for the image 
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data (see column 7, lines 20-35). Note, the Office interprets such color information production 
methods of Mizuno functionally equivalent to the "moving image reproducing section" of 
Applicant's claim. 

In reference to claim 5, Mizuno and Tarn et al. disclose all of the claim limitations as 
applied to claim 1 above. Tarn et al. discloses the pen or stylus creating "strokes" which 
comprise of engagement and disengagement points and position data in between these points 
representing the tracking motion of the stylus as it moves across the screen (see column 1, lines 
49-62). Note, the Office interprets such "strokes" defined in a functionally equivalent format to 
a vector type of Applicant's claim. Tarn et al. discloses "extracting" such drawing information, 
"strokes," from memory and combining it with other image data such as video data (see column 
3, lines 61-66, column 6, lines 49-61, column 7, lines 1-36 and columns 7-8, lines 67-4). Note, 
the image control section, image combining section and image drawing sections of Applicant's 
claims are interpreted functionally equivalent to the functions performed by the CPU of Mizuno. 
It would have been obvious to one of ordinary skill in the art at the time the invention was made 
to implement the pen/stylus and video based image combining techniques of Tarn et al. with the 
image data processing techniques of Mizuno in order to allow the viewing of real-time user 
interaction data along with the computer system application data on a display simultaneously 
creating a more user friendly environment (see column 2, lines 34-49 of Tarn et al.). 

In reference to claim 6, Mizuno and Tarn et al. disclose all of the claim limitations as 
applied to claim 5 above. Tarn et al. discloses "stroke" data comprising coordinate data (see 
column 6, lines 49-54), width data and grayscale intensity data (see column 8, lines 16-21). 
Note, the Office interprets that the "points count" limitation of Applicant's claim is inherently 
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found within the "stroke" data of Tarn et al. since Tarn et al. discloses the "stroke" data 
comprising coordinate and width data, which the Office interprets as inherently comprising a 
"points count." 

3. Claim 1 1 is rejected under 35 U.S.C. 103(a) as being unpatentable over Mizuno (U.S. 
Patent 6,463,183 B2), Tarn et al. (U.S. Patent 5,754,186) and further in view of Dempski et al. 
(U.S. Publication 2004/0155902 Al). 

In reference to claim 11, Mizuno discloses an image data processing method and 
apparatus and storage medium that extracts an object from an image and combines this object 
with another image to obtain a combined image without deteriorating picture quality (see column 
2, lines 22-27). Mizuno discloses a computer system comprising a CPU, disk drive and a 
display, among other elements which extracts, for example, a tennis player's racket object from 
input moving image data which is stored in, possibly, the disk drive (see column 4, lines 37-39, 
column 5, lines 44-48 and column 6, lines 47-50). Note, the Office interprets that such 
extraction takes place at an equivalent to rate of, "every predetermined time" as the entire image 
data processing method of Mizuno is implemented by the CPU executing in a loop programming 
structure (see Figure 8 of Mizuno) and therefore, the "every predetermined time" is interpreted 
as equivalent to the time taken for the CPU to perform all instructions in one iteration of the 
loop. Mizuno discloses the moving image data being in the format of an MPEG1 video format 
(see column 7, lines 55-58). Mizuno also discloses storing the object in memory (see column 2, 
lines 28-3 1). Mizuno discloses combining the racket object, which is extracted from moving 
image data, with a background image (see column 6, lines 12-16). Mizuno also discloses 
rendering the combined data continuously as the rendering step is located within the CPU loop 
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structure of Figure 8 in Mizuno. Although, Mizuno discloses combining extracted object data 
from moving data and combining such object data with a background image, Mizuno does not 
explicitly disclose extracting input drawing static information from a drawn input image. Tarn et 
al. discloses a method and apparatus for blending of first and second images loaded into 
corresponding VRAM buffers (see column 3, lines 57-58 of Tarn et al.)- Tarn et al. discloses the 
apparatus comprising a computer system which includes a writing device such as a pen or stylus 
that allows the user to write on the screen of a display (see column 5, lines 36-58 and column 6, 
lines 47-49). Tarn et al. discloses "extracting" such drawing information from memory and 
combining it with other image data such as video data (see column 3, lines 61-66, column 6, 
lines 49-61, column 7, lines 1-36 and columns 7-8, lines 67-4). Note, the image control section, 
image combining section and image drawing sections of Applicant's claims are interpreted 
functionally equivalent to the functions performed by the CPU of Mizuno. It would have been 
obvious to one of ordinary skill in the art at the time the invention was made to implement the 
pen/stylus and video based image combining techniques of Tarn et al. with the image data 
processing techniques of Mizuno in order to allow the viewing of real-time user interaction data 
along with the computer system application data on a display simultaneously creating a more 
user friendly environment (see column 2, lines 34-49 of Tarn et al.). Neither Mizuno nor Tarn et 
al. explicitly disclose their image data processing techniques within a teleconferencing 
environment however Dempski et al. does. Dempski et al. discloses a computer system in a 
teleconferencing environment for superimposing a computer-generated image onto a video 
image or vice versa (see paragraphs 5 and 1 1 of Dempski et al.). It would have been obvious to 
one of ordinary skill in the art at the time the invention was made to implement the 
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teleconference superimposing techniques of Dempski et al with the pen/stylus and video based 
image combining techniques of Tarn et al. and image data processing techniques of Mizuno in 
order to allow multiple users to view, manipulate, and share data in a teleconferencing 
environment making it easier to communicate to users in remote locations (see paragraphs 2-3 of 
Dempski et al.). 

Response to Arguments 

4. Applicant's arguments, see page 1 1 of Applicant's Remarks, filed 04/17/06, with respect 
to the IDS have been fully considered and are persuasive. The IDS filed 04/22/04 has been 
considered by the Examiner. 

5. Applicant's arguments, see page 1 1 of Applicant's Remarks, filed 04/17/06, with respect 
to the objection of the specification have been fully considered and are persuasive. The 
objection of the specification has been withdrawn since minor informalities have been corrected 
for. 

6. Applicant's arguments, see page 1 1 of Applicant's Remarks, filed 04/17/06, with respect 
to the objection of the drawings have been fully considered and are persuasive. The objection of 
the drawings has been withdrawn since all reference numbers are now accounted for within the 
specification. 

7. Applicant's arguments, see page 1 1 of Applicant's Remarks, filed 04/17/06, with respect 
to the objection of claims 1,10 and 1 1 have been fully considered and are persuasive. The 
objections of claims 1,10 and 1 1 have been withdrawn since minor informalities have been 
corrected for. 
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8. Applicant's arguments filed 04/1 7/06 have been fully considered but they are not 
persuasive. 

In reference to claims 1-11, Applicant argues that neither Mizuno nor Tarn, either alone 
or in combination, discloses or suggests at least, "extracting input drawing static information 
from a drawn input image every predetermined time ," (see page 12 of Applicant's Remarks). 
Applicant further disputes that even if Mizuno does teach the CPU executing in a loop 
programming structure (see Figure 8 of Mizuno), Mizuno does not teach that one cycle is 
executed every predetermined period. The Office strongly disagrees and points to Figure 8 of 
Mizuno. The Office interprets the entire process flow shown in Figure 8 to take x amount of 
time with this amount of time being divided between the various steps (S1-S5) of Figure 8. In 
view of the above and further with reference to Mizuno disclosing the process flow of Figure 8 
executing in a loop (see "Main Loop" of Figure 8) and Mizuno performing extraction of objects 
within the loop (see column 5, lines 44-48, column 6, lines 47-50 and column 7, lines 7-20), the 
Office believes that the "every predetermined time" of Applicant's claims is inherent in the 
teachings of Mizuno. Further, since it is well known in the art that programming loops operate 
in cyclic or recurring form, the Office interprets that extraction occurs in Mizuno "every 
predetermined time" because the process flow of Figure 8 is recurring and each step in the loop 
takes a specific amount of time to execute. Therefore, the Office believes Mizuno and Tarn to 
teach all of the claim limitations as applied to claims 1-1 1 and maintains the previous rejection in 
view of this prior art. 



Conclusion 
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THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within TWO 
MONTHS of the mailing date of this final action and the advisory action is not mailed until after 
the end of the THREE-MONTH shortened statutory period, then the shortened statutory period 
will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 
CFR 1.136(a) will be calculated from the mailing date of the advisory action. In no event, 
however, will the statutory period for reply expire later than SIX MONTHS from the mailing 
date of this final action. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Antonio Caschera whose telephone number is (571) 272-7781. 
The examiner can normally be reached Monday-Thursday and alternate Fridays between 7:00 
AM and 4:30 PM. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Kee Tung, can be reached at (571) 272-7794. 

Any response to this action should be mailed to: 

Commissioner of Patents and Trademarks 
Washington, D.C. 20231 

or faxed to: 

571-273-8300 (Central Fax) 
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Any inquiry of a general nature or relating to the status of this application or proceeding 
should be directed to the Technology Center 2600 Customer Service Office whose telephone 
number is (571)272-2600. 



#C PATENT EXAMINER 

6/29/06 




